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ABSTRACT 

This report analyzes 1990-91 "report card" data for 
Tennessee 1 s schools, making comparisons to earlier studies when 
appropriate. Of particular importance are the analyses of the 
relationships among 15 school district characteristics and mean 
student outcomes (scores from Tennessee f s Comprehensive Testing 
Program and the Tennessee Proficiency Test) at the system, school, 
and grade levels. Findings showed that student attendance and 
free/reduced lunches are the factors most influencing achievement. At 
the system level, student attendance, expenditure per pupil, and 
percentage of Chapter 1 students had the greatest effect on student 
outcomes. Some school-level factors (percent student attendance, 
percent oversized classes, free/reduced lunches, and expenditure per 
pupil) and grade-level factors (percent student attendance, 
expenditure per pupil, percent career ladder teachers, and percent 
free/reduced lunches) demonstrated dramatic upward or downward shifts 
of influence. Together, the 15 district factors studied accounted for 
less than 50 percent of the total influence on achievement at any 
school level. Some highly regarded factors (percentage of oversized 
classes, average educator salaries, per capita income, percentage of 
enrollment change, and district size) had relatively little effect on 
student achievement. Conclusions and implications are provided, along 
with an executive summary, nine references, and seven appendices of 
data tables. (MLH) 
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BACKGROUND AND PROCEDURES 

The investigators have completed a series of 
studies of the data reported in Tennessee's 1988- 
89 and 1990-91 school district report cards. This 
report focuses on results of the analysis of 1990- 
91 data with comparisons, where appropriate, to 
findings of the earlier studies. Of particular 
importance are the analyses of the relationships 
between 15 school district characteristics 
(independent variables) and mean student 
outcomes (average achievement scores used as 
dependent variables) at the system level, school 
level (i.e., elementary, middle, high), and 
individual grade levels (2nd - 8th and 10th). 
Measures of student outcomes were results from 
Tennessee's Comprehensive Assessment 
Program (TCAP) and the Tennessee Proficiency 
Test (TPT). 

Two correlation procedures (Guttman's partial 
correlation (Y) and coefficients of determination 
("i*")) were used to generate the data used as the 
basis for the primary analyses. Additional study 
procedures included the rank ordering of school 
districts by Mean Student Outcome (MSOs) and 
the computation of z-scores to assist in trend 
analysis of MSO. 



SELECTED FINDINGS 

Among the more interesting findings of the 
study were the following: 

1. In both this study and one conducted earlier 
on 1988-89 report card data, student 
attendance (11%, 13%) and percent 
free/reduced lunches (6%, 5%, respectively) 
stand out as the two factors having greatest 
influence on achievement. 



2. At the svstem-level . student attendance 
(13.3%), expenditure per pupil (9.4%), and 
percentage cf Chapter I students (6.5%) have 
the most impact on student outcome (see 
Table 1, p. 3). However, these factors did not 
have the same impact or the greatest impact 
at all schooi and grade levels. 

3. Some school-level factors (percent student 
attendance, percent oversized classes, percent 
free/reduced lunches, and expenditure per 
pupil) and grade-level factors (percent of 
student attendance, expenditure per pupil, 
percentage of Career Ladder teachers, 
percentage of free/reduced lunches) 
demonstrated dramatic upward or downward 
shifts in influence {see Tables 2 & 5). 
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4. Together, the 15 district factors studied 
accounted for less than 50 percent of the total 
influence on achievement at any school level 
(/.a, elementary, middle, high school) or grade 
level (Table 2). When the school levels were 
examined, the greatest impact of the combined 
factors came at the high school (41%) and the 
smallest impact occurred at the middle school 
(35%). At individual grade levels, the greatest 
impact of the combined 15 factors was at the 
4th grade (48%), and the least impact was at 
the 6th grade (19%). 

5. Some highly regarded factors such as 
percentage of oversized classes, average 
professional educator salaries, per capita 
income in the school district, percent of 
enrollment change, percent of special 
education, and size of the school district had 
relatively little impact on student achievement. 

POLICY RELATED CONCLUSIONS AND 
IMPLICATIONS 

Several conclusions and implications 
extrapolated from the findings are worthy of 
discussion by report card developers and 
policymakers at the local, state and national levels: 

1. Improvement in student academic performance 
will require that all controllable factors in a school 
or school district receive attention, not just one or 
two (e.g., class size, per pupil expenditure, 
professional salaries, etc.) that are high on the 
agenda of one or another stakeholder groups. 

2. Improvement in student academic 
performance requires that we identify the 
factors that account for the remainder of the 
influence on student outcomes. This means 
that school districts must collect data on school 
climate and culture, instructional methods, 
school organization, parental involvement, 
student attitudes, and other factors. Oniy 
analyses of the relationships between these 
factors and student outcomes can provide us 
the additional information that we need. 



3. Report cards containing only system-level data 
are of little value in determining what can or 
should be done to bring about improvement in 
student performance. The interactions 
between district and school characteristics and 
student outcomes are complex, and they vary 
greatly by school level and grade level. 

4. The findings of this study suggest that 
unquestioning equal treatment of schools within a 
district and students at all grade levels in terms of 
expenditures, placement of teachers, class size, 
and other matters may actually create educational 
inequities. Provision of equal educational 
opportunity may very well require dissimilar 
allocations of human and financial resources. 

5. Findings from this study and its predecessors 
suggest that the tests/assessments chosen to 
measure student performance are critical factors in 
determining what is currently working in a particular 
context and what needs "fixing/ The data 
generated from such analyses are only as good as 
the assessments administered to students. 

6. Infusion of money is clearly not the single 
prerequisite to improved student academic 
performance. In this and the previous studies, 
too many school districts demonstrated student 
outcomes inconsistent with expectations based 
on financial conditions in the district. While 
financial recources are important to student 
achievement, there is evidence to suggest that 
other factors are equally, and in some cases, 
more important. 

7. The purpose(s) of a school report card should be 
established before the context and format of the 
report card are determined. Simple reporting of 
the status of a series of factors within a school or 
district can be done in several ways, using a 
variety of information. However, the 
development of a report card that will assist 
educators, policymakers and stakeholder groups 
in targeting areas and strategies for improvement 
requires quite different content and format. 



ADDITIONAL CONCERNS 

In an additional analysis the investigators 
applied to the 1990-91 data three statistical 
treatments currently in use in analyzing 
relationships among report card variables. 
Guttman's partial correlation, stepwise regression 
and multiple regression analyses yield very 
different pictures of the impact of 
community/school variables on student 
achievement. 

These findings suggest that researchers and 
policymakers need to reach some common 
agreement about how best to analyze and report 
data, particularly if the results of the analyses are 
to have utility in school improvement efforts 
and/or impact on school funding. 



Copies of the complete study can be 
obtained by contacting: 

Dr. Russell L French, Suite 3, Claxton Hall, 
University of Tennessee, Knoxville, TN 
37996 

Phone: (615) 974-3103, or 

Dr. Gordon C. Bobbett, 8325 Richalnd Colony 
Rd., Knoxville, TN 37923 
Phone/Fax: (615) 691-4253. 

Dr. Charles M Achilles, 1000 Garden St., 
University of North Carolina-Greensboro, 
Curry Building, Greensboro, NC 27412-5001 
Phone: (919)334-5100 



Table 1. Comparison of Influence Exerted on Student Academic Outcomes by 
School District Characteristic in 1988-89 and 1990-91. 

Percentage of Influence (district level) 



District Characteristics 1988-89 1990>91 

« County Per Capita Income 0.4 0.4 

• Average Professional Salaries I 5.6 1 0.1 

• Expenditure Per Pupil 0.0 I 9-4 1 

• Average Daily Membership 2.8 0.9 

• % Student Attendance 110.91 113.31 

• % Oversized Classes 0.3 3.1 

• % Free/Reduced Lunches I 6.0 1 I 4.7 1 
•% Career Ladder I! & III 0.2 3.1 

• Number of Schools in District 0.4 

• % Enrollment Change 1 .5 

• % Regular Diplomas 1 .5 

• % Honors Diplomas 0.2 

• % Students enrolled in 

Vocational Education 2.9 
' % Students in 

Special Education 0.2 

• Percentage of Chapter 1 Students I 6.5 1 

Total Percentage of Influence 26.5 48.2 



Box> 4% Percentage of Influence 

a 



5 



Table 2. Comparison of influence Exerted on Student Academic Outcomes by 
School-level, 1990-91 Tennessee Report Card data. 

Elementary Middle Secondary System 



District Characteristics 



County Per Capita Income 
Average Professional Salaries 
Expenditure Per Pupil 
Average Daily Membership 
% Student Attendance 
% Oversized Classes 
% Free/Reduced Lunches 
% Career Ladder II & III 
1 Number of Schools in District 

■ % Enrollment Change 

• % Regular Diplomas 

• % Honors Diplomas 

■ % Students enrolled in 

Vocational Education 

■ % Students in 

Special Education 
Percentage of Chapter 1 Students 



Total Percentage of Influence 



0.4 
1.0 

qui 

0.1 

OC3 

3.4 

0.2 
0.3 
1.1 
0.3 

0.8 

1.5 
2.1 



0.0 
0.3 

33] 
0.2 

jDD 

2.8 
2.3 
AM 
0.0 
0.3 
1.9 
1.5 

1.0 

0.1 



39.6 



35.3 



0.6 
2.7 
0.4 
"53 



T3~5 

0.3 
0.0 

3.5 
0.2 
0.4 

□El 
o.o 



40.9 



0.4 
0.1 

rm 

0.9 

3.1 

3.1 
0.4 
1.5 
1.5 
0.2 

2.9 

0.2 



48.2 



Table 3. Comparison of Influence Exerted on Student Academic Outcomes by 
Grade-level, 1990-91 Tennessee Report Card data. 



District Characteristics 



CM 



"2 

CO 



CO 



CO 



• County Per Capita Income 2.3 

• Average Professional Salaries 0.0 

• Expenditure Per Pupil 1 .6 

• Average Daily Membership 0.5 

• Student Attendance 113.21 

• % Oversized Classes 2.0 

• % Free/Reduced Lunches 0.8 

• % Career Ladder II & III [15^1 

• Number of Schools in District 0.4 

• % Enrollment Change 0.0 
•% Regular Diplomas 0.1 

• % Honors Diplomas 0.8 

• % Students enrolled in 

Vocational Education 0.0 

• % Students in 

Special Education 2.1 

• Percentage of Chapter 1 

Students 0.1 



0.1 0.0 
0.9 1.7 

dm [Mi 



0.2 
3.5 
1.6 
2.5 
0.4 
0.7 
0.4 
0.2 
0.5 

0.0 

0.2 

3.9 



0.9 
3.0 



S3. 



A5l 



0.0 
0.7 
1.7 



5.2 



1.9 
1.6 



0.0 
0.8 

[ToTel 

0.2 
0.0 
0.5 

qui 

1.5 
0.3 
1.5 
1.1 
0.0 



1.6 
1.1 



0.6 
0.1 
"461 
0.0 
1.1 
2.2 
2.8 
2.0 
0.0 
0.4 
0.3 
1.8 



ran o.6 1.0 



0.5 
2.4 



0.1 
0.7 

L£2 
0.0 

2.7 
1.4 

0.3 
0.3 
0.8 
1.3 

2.2 

0.8 

2.4 



0.7 
0.1 

\AJL\ 
0.6 
0.3 
2.8 
0.3 
1.9 
3.4 
0.1 

0.0 

0.7 

CEZl 



o.o 

2.9 
0.6 
0.9 
3.0 
1.3 
0.3 
1.5 
0.6 
0.6 
1.0 
0.0 

2.2 

2.5 

2.0 



Total Percentage of Influence 39.9 26.9 48.3 31.2 



30.6 26.7 19.5 



Box > 4% Percentage of Influence 



THE IMPACT OF COMMUNITY/SCHOOL CHARACTERISTICS ON STUDENT OUTCOME: AN 
ANALYSIS OF REPORT CARDS ON SCHOOLS 1 

I. INTRODUCTION 

This paper represents the latest in a series of studies of data reported on Tennessee's school 
district report cards. Previous reports focusing on 1988-89 and 1990-91 report card data have been 
presented at this meeting (1992), the annual conference of the American Association of School 
Administrators (1992,1993), the Mid-South Educational Research Association (1991,1992) and several 
other meetings (see References). The investigations of 1988-89 report card data explored the 
relationships among eight school district variables (average attendence, average professional salaries, 
county per capita income, expenditure per student, average daily membership, percentage of oversized 
classes, percentage of students on free or reduced lunches, and percentage of educators on upper 
Career Ladder levels II and II!) and the relationship between each variable and average student test 
scores at the school district level. In 1990-91 , Tennessee began use of its new Tennessee 
Comprehensive Assessment Program (TCAP), thereby creating a new set of student outcome measures. 
This change made possible interesting extentions of the 1988-89 report card studies, but it also made 
comparison of certain findings in the two sets of studies impossible. 

TCAP results were reported in greater detail in the 1990-91 report cards than had been true with 
earlier report cards and outcome measures. The 1990-91 and subsequent report cards report TCAP 
results at substanitally more grade levels within school districts (2-8,10) making possible study of 
relationships among school district characteristics and student outcomes at both school levels 
(elementary, middle, secondary) and individual grade levels. 

in addition, 1990-91 and report cards thereafter have added information about more school 
district/community variables. This paper and other recent investigations contain analyses involving 15 
rather than 8 variables. The seven added variables include number of schools in the district, precentage 
of enrollment change, percentage of regular diplomas awarded, percentage of honors diplomas awarded, 
percentage of vocational students, percentage of special education students, and percentage of Chapter 
I students. 



1 . This paper includes material presented at the annual meetings of MSERA (1 1/92), SRCEA 
(11/92) and AASA (2/93) and extends the analyses of data to produce several interesting new findings. 

1 
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Tables 1 and 2 present a Tennessee school district report card as it appeared in 1988-89. 
Tables 3 and 4 present a 1990-91 report card. These figures are essential to the reader's understanding 
of what was and was not available to the researchers as a database. They also provide graphic 
representations of Tennessee's report cards as they have appeared since the mid-1980s. 

ii. METHODOLOGY 

The 1990-91 report cards provided test results for grades 2 through 10. The investigators 
conducted analyses at the school system/district level, school-level and individual grade-levels. School- 
level analyses organized data at four levels: elementary (grades 2-5), middle school (grades 6-8), high 
school (9-10), and system-level (grades 2-10). 

Mean student outcomes (MSOs) were created {by converting reported scores to 2 scores and 
computing their means) for each level by combining TCAP data for the grades defined within the 
particular level. For the high school level, the MSO was created by combining 10th grade TCAP data 
with the scores reported for the 9th grade Tennessee Proficiency Test (TPT). These MSOs were treated 
as dependent variables, as in the earlier studies. The 15 school district characteristics studied were 
treated as independent variables that influence student outcomes. To guide the study eleven research 
questions were developed: 

1 . How do school district characteristics currently reported relate to student academic achievement 
results? 

2. Are there differences in the relationships between dependent and independent variables at 
different school levels (elementary, middle, high school, system)? 

3. Are there differences in the relationships between dependent and independent variables at 
different grade levels (2nd, 3rd, 4th, etc.) 

4. How do reported school characteristics relate to each other? 

5. When rank ordered on the basis of student outcomes, how do school districts within the state 
perform in terms of reported school and community characteristics? 

6. Do the reported school district characteristics appear to represent all or most factors that 
influence student academic achievement? 

7. Is there evidence of major change in student academic performance from one school level to 
another within school districts? 

8. When academic achievement is treated as scores on two separate test batteries (TCAP and 
TPT), are patterns of influence changed? 

9. What differences in relationships among variables exist when test results of special education 
students are included in the analyses? 

10. How do the results of this study compare with the results of the investigation using 1988-89 
report card data? 

2 
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Table 1 . 



Testing Information For Widget City Schools (1988-89 Report Card Data) 



Testing Information 
for Widget City 


Grade 
Level 


1987-88 


1988-89 


State 
Average 


Basic Skills First 
Achievement Test 

(percent score) 


Reading 


3 


90 


88 


80 


6 


82 


80 


77 


8 


92 


91 


81 


Math 


3 


91 


90 


82 


6 


67 


71 


66 


8 


77 


84 


66 


Stanford 
Achievement 
Test 

(Stanine score) 

7-9 = High 
4-6 * Average 
1-3= Low 


Reading 


2 


6 


7 


6 


5 


6 


6 


5 


7 


6 


6 


5 


Math 


2 


7 


8 


6 


5 


7 


6 


6 


7 


7 


7 


5 


Spelling 


2 


6 


7 


6 


Language 


5 


6 


6 


5 


7 


6 


6 


5 


Environment 


2 


7 


7 


6 


Science 


5 


6 


7 


6 


7 


6 


6 


5 


Listening 


2 


7 


7 


5 


5 


6 


6 


5 


7 


6 


6 


5 


Social 
Science 


5 


6 


6 


5 


7 


6 


6 


5 


Stanford Test of 
Academic Skills 

(TASK 2) 

7-9 m High 
4-6 = Average 
1-3 = Low 


Reading 


9 


6 


6 


5 


12 


6 


6 


5 


Math 


9 


6 


6 


5 


12 


6 


6 


5 


English 


9 


7 


6 


5 




c 
O 


I 


c 
O 


Science 


9 


7 


6 


5 


12 


6 


6 


5 


Social 
Science 


9 


5 


6 


5 


12 


6 


5 


5 


Tennessee Proficiency Test 

(% Students Passing) 


Language 


9 


88 


92 


78 


Math 


9 


95 


98 


90 


Both 


9 


86 


91 


76 



3 
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Table 2. System Information for Widget City Schools (1988-89 Report Card Data). 



System Information 
for Widaet Citv 


Grade 
Level 


1986-87 


1987-88 


1988-89 


State 
Average 


Number of Schools 


K-12 


5 


5 


5 


12 


Average Daily Membership 


K-12 


3,291 


3,394 


3,372 


5,874 


% Student Attendance 


K-12 


7 








% Enrollment Change 


9-12 


-13.0 


-16.1 


-15.2 


-24.7 


% Oversized Class 


K-12 


1.2 


1.4 


2.3 


3.8 


% of Students on Free or Reduced Price Lunch 


K-12 


23 


21 


21 


42 


Expenditures per pupil 


K-12 


$2,71 8 


$3,299 


$3,501 


$3,304 


County Per Capita Income 


K-12 


if 


M 


$12,819 


$12,878 


% Elementary Schools Accredited by SACS 


K-8 




100.0 


100.0 


29.1 


% Secondary Schools Accredited by SACS 


7-12 


100.0 


100.0 


100.0 


64.9 


Professional Educator Information 












% Professionals on Career Ladder Levels II & III 


K-12 


22.9 


21.9 


25.6 


14.8 


Average Professional Salary 


K-12 


$25,198.60 


&o£ noc AA 


$30,804.37 


$26,756 


Student Information 












% Diplomas 
Granted 


Regular 


Id 


yu.o 


oo./ 


/5.8 


81 .8 


Honors 


12 


49.6 


26.7 


20.0 


8.5 


Special Education 


12 


1.8 


1.4 


1.5 


1.9 


Certificate of Attendance 


12 








0.9 


Seniors not Receiving 
Diploma in Spring 
Graduation 


12 


2.7 


3.2 


2.7 


6.9 


% Students in Vocational Education Courses 


7-12 


33.0 


40.9 


41.0 


45.5 


% Students in Special Education 


K-12 


12.1 


11.3 


12.1 


14.2 


% Chapter 1 Students 


K-12 


13.3 


15.5 


12.4 


11.9 
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Table 3. Testing Information For Widget City Schools Too (1990-91 Report 
Card Data). 

Widget Too Schools 



aw 






Year 


2 


3 


4 


5 


6 


7 


8 


10 


Reading 


State Avq. 


na 


na 


na 


na 


na 


na 


na 


na 




1990-91 


7 


6 


6 


6 


6 


7 


7 


6 


TENNESSEE 


GRi 


*DE 


COMPREHENSIVE Language 
ASSESSMENT 

PROGRAM (TCAP^ r 

Main 


Year 


2 


3 


A 


5 


6 


7 


8 


10 


State Avg. 


na 


na 


na 


na 


na 


na 


na 


na 


1990-91 


7 


6 


6 


6 


6 


6 


7 


6 


OR 


ADF 


Year 


2 


3 


4 


5 


6 


7 


8 


10 


State Avg. 


na 


na 


na 


na 


na 


na 


na 


na 


1990-91 


7 


7 


7 


6 


6 


7 


7 


7 




GR 


ADF 




Year 


2 


3 


4 


5 


6 


7 


8 


10 


State Avg. 


na 


na 


na 


na 


na 


na 


na 


na 


1990-91 


7 


6 


7 


6 


6 


7 


6 


6 


Studies 


GRADE 


Year 


2 


3 


4 


5 


6 


7 


8 


10 


State Avg. 


na 


na 


na 


na 


na 


na 


na 


na 


1990-91 


7 


6 


7 


6 


6 


6 


S 


6 








Grade 9 




TENNESSEE L ™W*& 


Year 


With Special Ed. 


Without Special Ed. 




State Avg. 


na 


na 


1990-91 


90 


91 


PROFICIENCY 

TEST (TPT) Mathematics 






Year 


With Special Ed. 


Without Special Ed. 




State Avq. 




na 


1990-91 


98 


98 








Both 


Year 


With Special Ed. 


Without Special Ed. 




State Avq. 




na 


1990-91 


88 


90 









Testing Information 

Students In Tennessee are given two types of tests. 

Students were introduced this spring to the 
Tennessee Comprehensive Assessment Program 
(TCAP). This program mandates a customized, norm 
referenced and criterion referenced test for grades 2 
through 8, a norm referenced test for grade 10, and the 
Tennessee Proficiency Test. 

The customized test will allow each teacher to 
assess progress of students during the school year with 
a minimum amount of testing time. The program will 
generate consistent types of test scores from grade to 
grade. The norm referenced data will allow longitudinal 
status of individual, school, system, and state growth in 



order to evaluate and improve programs and curricula. 
The criterion referenced data will report the mastery , 
partial mastery, and non-mastery of tested domains for 
each school year. Although the objectives for the 
Tennessee Proficiency Test has been updated, the rules 
and regulations governing the test will remain the same. 

The Tennessee Proficiency Test measures 
minimum skills in mathematics and language arts. 
Students must achieve a passing score of 70 percent 
correct on both the math and language arts tests in order 
to fulfill one of the requirements for receiving a regular 
diploma. Students take the test for the first time in the 
ninth grade. 
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Table 4. System Information for Widget City Schools Too (1 990-91 report card data). 



Widget Too 



Svstem Information 


Grade 
Level 


1988-89 


1989-90 


1990-91 


State 
Averaae 


Number of Schools 


K-12 


5 


5 


5 


na 


Average Daily Membership 


K-12 


3,372 


3,9290 


3,436 


na 


% Student Attendance 


K-12 


95.1 


95.8 


95.6 


na 


% Enrollment Change 


9-12 


-15.2 


-12.1 


-20.1 


na 


%Oversized Classes 


K-12 


2.3 


1.4 


1.5 


na 


% of Students on Free or Reduce Lunches 


K-12 


21.0 


22.0 


23.0 


na 


Expenditure per Pupil 


K-12 


$3,501 


$3,942 


$4,073 


na 


County Per Capita Income 


K-12 


$12,819 


$13,662 


$14,192 


na 


% Elementary Schools Accredited by SACS 


K-8 


100 


100 


100 


na 


% Secondary Schools Accredited by SACS 


7-12 


100 


100 


100 


na 


Professional Educator information 




% Professionals on Career Ladder II and III 


K-12 


25.6 


28.6 


30.8 


na 


Average Professional Salary 


K-12 


$30,804.37 


$31,590.60 


$33,753.00 


na 


Student Information 




% Diplomas 
Granted 


Regular 


12 


75.8 


73.4 


79.5 


na 


Honors 


12 


20.0 


22.0 


18.6 


na 


Special Education 


12 


1.5 


0.9 


1.0 


na 


Certificate of Attendance 


12 




.09 




na 


Seniors not Receiving 
Diploma in Spring 
Graduation 


12 


2.7 


2.8 


1.0 


na 


% Students in Vocational Education Courses 


7-12 - 


41.0 


41.3 


39.3 


na 


% Students in Special Education 


K-12 


12.1 


12.6 


13.6 


na 


% Chapter 1 Students 


K-12 


12.1 


12.6 


8.7 


na 



Other Information: 

Percent of Stud** In Attendant* (%? A). 

This figure shows the average percent of student in 
alterx&nce daily in your school system for the 1990 
91 year. 

Percent Enrollment Change (SEC). This 
figure shows ihe percent change in a group of 
sudent who started in the ninth grade four year* 
ago and should have completed the V/etfth grade 
this year, tt is a four year average. Decreases 
happen when students drop out of a school, move 
away, graduate earty . fail ft year, or leave school for 
other reasons not listed. 

Percent of Oversized Claaaaa (%OC). This 
figure shows ihe percent of dasses in ail grade 
levels which had waiveni for being over the 
maximum class size. Maximum class sizes in 
Tennessee are 25 for grades K-3; 28 for grade 4, 30 
for grades 5-6; 35 for grades 7-12; 23 for vocation. 

Percent Student! on Free or Reduced 
Lunchee (%FRL): Students whose famity income 
meets certain criteria are eligible for free or reduced 
price lunches. This figure shows the percent of 
student sin vox school system who receive free or 
reduced price lunches. 

Expenditure par Pupil (EPP). This figure 
shows the average number of dollars spent for each 
pupil in average dairy attendance for your schod 
system. 

County Par Capita IncomefCO): This figure 
represents the per capita personal income fa the 
county in which your school system is located. The 
most recent fiouree available from the U.S. Bureau 
of Economic Analysis are for 1 968. 



Percent EtarnantaryrBacondary Schools 
Accredted by SACS (%ES): Schools may elect to 
seek accreditation from the Souther Association of 
College and Schools (SACS) in addition to receiving 
stale approval. This agency recognizee quaity 
schools, ir wntaina a list of aocrecfted schools and 
requires a continuing school improvement program. 

Percent PtofeeatoneJe on Career Ladder 
L5ve*s<andl(%CU: This figure show t» 
percent of pro fs sa io n afstoff in your school system 
who have mat the standards tor Career Levels II 
andll. Theeearethe upper rungs of Tennessee's 
Career Ladder program. The number includes 
regular classroom teachers, guidance counselors, 
librarians, and administrators. 

Average P r ot see io nal Salary (APS): This 
figure shows the estimated average salary for al 
certificated personnel in your school system. 

D4pk>mea Granted: Theee figures shew the 
peroent of the twerfth grade ciasa receiving Afferent 
types of Gliomas. Seme school systems nave 
requirement that may exceed these standards. 
Tennessee students may receive tour kinds of 
diptomas; 

High School Optoma (EVHS): Awarded to 
ttudents who (a) earn 20 unrti of credrt, (b) m^e 
passing scores on al components of the 
Proficiency Test and (c) are satisfactory records 
of attendance and conduct 

Honow Diploma (D>WO): School systems 
n^c^ancotionaidiptomatostiJdenttv^ 
meet increased rsquirements established by the 
State Board of Education. The requirements 
include accelerated English, math, science and 



social stodents, and a 3.0 grade point average. 

Speciei Education Diptoma (D-SE): 
Awarded to students who have satisfactorily 
completed an individualized Education F 
and who have sai is fsct^ recccoWafl 
and conduct, but who have notpeeeed al 
components of the Proficiency Test 

CertrAcsse of Attendsnoe (O-CA): Awarded 
to stodents who have earned 20 units of credit 
and who have satisfactory records of attendance 
and conduct, but who Ml to meat Proficiency 
Test standards. 

Studsnta Not r teceMrc Dtptoma in Spring 
Graduation (ONR): This figure represents 
stulentswhowireceh^twdtoton^a^ 
completing summer school or who fafled to 
compiete hic^h s chool. ^ 
Percent of Studenta in Vocational Education 
Couraaa (%VO): This figure shews the percent of 
the school system's average dar)y membWahip 
erYoliedincoeamorevcca»cnaiec^Jcai^ 
courses. Studenteenroliedinmoretwione 
vocaionoj course* are courted onry oooe. 

Percent of Students In Specie! Education 
(%SE): Tftsfig^fhcw the parcerrt erf students in 
your school system who are receiving special 
education services. 

Percent of Chapter 1 Students (%CH1): 
Chapter 1 is a federally funded program to assist 
students in the areas of reecSng and mafiematics. 
This figure shows the percent of student receiving 
services under Chapter 1 . 
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How might the findings of this study inform educational policy at state and local levels? 



Five of the eleven questions replicate questions posed in the previous study; items 2, 3, 7, 9, and 10 are 
new questions representing the capacity available in the 1990-91 report cards to analyze data at several 
levels within the school districts and the capacity of the current study for comparison with the earlier 
study results. Question 8 is a modification of a qy*stion posed in the earlier study, because only two test 
batteries (rather than three) were used in the current analysis. The remaining questions were used in 
previous studies and again here in order to provide a framework for comparisions. 

As in the studies using 1988-89 data (121 districts out of a total of 138 districts), 120 of 138 
districts reported comprehensive scores on both TCAP and TPT. These districts (120) constitute the 
sample for analysis: 

Twenty school district characteristics were actually reported in the 1990-91 report cards. In 
responding to research Question #1, the investigators first evaluated si' characteristics to determine their 
value as independent variables. A KaiserXesX of variable sample adequacy was applied to each variable 
at each level (elementary, middle, high school, and system). Five characteristics were eliminated from 
further study: percent elementary schools accredited by SACS, percent high schools accredited SAGS, 
diplomas granted in special education, certificates of attendance granted as diplomas, and seniors not 
receiving diplomas in Spring graduation. Appendix A presents the results of this analysis. 

Two correlation procedures were used to generate a response to research question #1 . A 
Pearson Product Moment correiation enabled comparison of variables, and Guttman's partial correlation 
allowed the researchers to develop percentages of influence to assess relationships between 
independent and dependent variables. 

To answer research question #2, the correlation 0 (Pearson and Guttman's) were generated for 
each independent-dependent variable relationship at each of the four defined school levels. 

Question #3 again required the use of Guttman's partial correlation procedure. In this analysis, 
correlations between each of the 15 school/community characteristics and Mean Student Outcome (MSO) 
at each grade level, two through ten were computed. 

Research question #4 was answered by computing correlations among independent variables. A 
coefficient of determination (r 2 ) showed the levels of interaction between categories (variables). 

Research question #5 required the rank ordering of school districts within the sample by system 
MSO. Comparisons of rankings at all school levels (elementary, middle, secondary) could be made. 
Only the top 10 and bottom 10 districts in the rankings are reported. 
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Research question #6 required no further statistical analyses. The partial correlation coefficients 
and related percentages of influence previously developed provided the necessary data. 

To answer research question #7, changes in MSO upward and downward of one standard 
deviation from school level to school level were first computed using Z-scores as the basis for the 
computation. To further clarify the results, school-level rankings were developed. 

For research question #8, the investigators applied the Guttman partial correlation procedure to 
the relationship between each independent variable and each of the two test scores (TCAP and TPT) 
used in generating the high school MSO. 

Research question #9 required application of the statistical procedures previously used to the 
relationships between each of the 15 school district characteristics and TPT test scores for grade nine 
under two conditions: with and without special education student's scores. 

Research question #10 allowed the investigators to compare and contrast findings from the 
1988-89 studies and the 1990-91 studies, wherever comparisons appeared to be valid. Some results 
could not be compared because different test batteres were used in the two different years. 

Question #1 1 was used as a means of focusing conclusions and implications. Report cards on 
schools and the data included in them generate policy discussions. The findings of this study when 
added to those of the earlier ones should be useful to policymakers at ail levels. 

111. FINDINGS 

Findings are reported in two ways: (A) a descriptive analysis of the 120 school districts used in 
the study, and (B) responses to the research questions. 

A. Descriptive Analysis of School Districts 

m profile of the 120 school districts qualifying for inclusion in the study was developed. For each 
category, the report card (state) mean score, standard deviation (SD), number of schools submitting data 
and ranges of scores or numbers were compiled. Table 5 presents the profile. 

1. System Information 

All school districts in the sample (120) reported scores for TCAP and for the TPT. When special 
education students were included in tho TPT results, 87.1 percent of all students passed the language 
test, 90.8 percent passed math, and 84.0 passed both. When special education students were excluded 
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Table 5. A Report Card Profile of 120 Tennessee School Districts Sampled, 
1990-91 data. 



Tennessee Proficiency Test (TPT) 
With Special Education 

Langucige 

Math 

Both 

Without Special Education 

Language 

Math 

Both 











District 


SB 


Max 


Mln. 


n 


mean 


6.9 


99 


66 


120 


87.1 


5.8 


100 


68 


120 


90.8 


8.3 


99 


58 


120 


84.0 


5.6 


100 


72 


120 


92.2 


4.6 


100 


74 


120 


94.9 


5.6 


100 


72 


120 


89.7 



20.1 


161 1 


120 


12.9 


12,415 


103,987 378 


120 


6,624 


1 


97.4 91.2 


120 


94.4 


9.4 


3.6 -48.3 


120 


-23.0 


3.5 


23 0.2 


103 


4.4 


142 


85 10 


120 


41.7 


$532 


$5,312 $2591 


120 


$3,442 


$2,257 


$22,097 $8,081 


120 


$12,371 


34.8 


100 3 


48 


60.4 


23.1 


100 25 


83 


85.3 



6.0 42.5 6.8 119 16.8 

$2,960 $36,505$23,262 120 $27,465 



System Information 

Number of Schools 
Average Daily Membership 
% Student Attendance 
%Enrollment Change 
% Oversized Classes 
% Free a Recboed larches 

Expenditure Pupil 
County Per Capita Income 
% El. Schools accredited by SACS 
% Sec. Schools accredited by SACS 

Professional Educator Information 

% Career Ladder II & III 
Average Professional Salary 

Student Information f% Dipl omas Granted) 

Regular 
Honors 

Special Education 
Certificate of Attendance 
Seniors not receiving 

Diploma in Spring Grad. 
% Students in Vocational Ed. Classes 
% Students in Special Ed. 
% Chapter 1 Students 



9.2 


98.7 


56.3 


120 


80.4 


7.0 


41.7 


1 


102 


13.7 


1.6 


8.6 


0.4 


107 


2.4 


0.7 


2.9 


0.1 


66 


.9 


4.3 


21.3 


0.3 


97 


6.5 


13.7 


98.8 


19.8 


120 


47.6 


3.9 


28.8 


8.2 


120 


16.4 


8.1 


47.5 


2.6 


120 


16.2 
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from the report, 92.2 percent of the students across the state passed the language test; 94.9 percent 
passed the mathematics test and 89.7 percent passed both tests. 

Most of the 120 school districts studied reported all data for the 20 report card categories. The 
exceptions: 103 reported percentage of oversized classrooms; 48 reported percentage of elementary 
schools accredited by SACS; 83 reported percentage of secondary schools accredited by SACS; 119 
reported percentage of professionals on Career Ladder II & III, and 66 reported percent of certificates or 
diplomas awarded. The statewide prof ile shows approximately 13 schools per district with an average 
daily membership of 6,624 students. In 1990-91 , student attendance averaged 94.4 percent statewide; 
enrollments in the districts decreased from the preceding year by an average of slightly more than 23 
percent (Note: We used only state-reported data in this study). Approximately 4.4 percent of all classes 
exceeded state prescriptions for class size. Almost 42 percent of all students statewide received free or 
reduced lunches. Per pupil expenditures averaged $3,442 per district, and county per capita income 
averaged $12,371. 

2. Professional Educator In formation 

Approximately 17 percent of all Tennessee educators had achieved Career Ladder Levels II or III 
by 1990-91 , and average professional salary was $27,465 (range: $23,262 to $36,505). As few as 6.8 
percent of the teachers in a district and as many as 42.5 percent had achieved upper Career Ladder 
status. 

3 Student Information 

Eighty percent of all diplomas awarded in the state in 1990-91 were Regular diplomas; almost 14 
percent were Honors diplomas; slightly more than 2 percent were Special Education diplomas, and about 
1 percent of all students leaving school were granted certificates of attendance. More than 6 percent of 
students graduating did not receive their diplomas during spring graduation. 

Almost 48 percent of Tennessee's students were enrolled in vocational education classes. Slightly more than 
1 6 percent were special education students, and another 1 6 percent were Chapter 1 programs. 

4. Comparison of selected 1990-91 data w ith 1988-89 data. 

A few comparisons of data from the 1990-91 profile (see Table 5) with data from 1 988-89 (see 
Table 6) are useful. Passing rates for the TPT had risen substantially in language (M=76%, 92%, 
respectively), and in passage of both language and mathematics tests by 1991 (M=76%, 84%, 
respectively). 

10 



Table 6. A Report Card Profile of 1 21 Tennessee School Districts sampled, 1 988-89 data. 



1 21 SCHOOL DISTRICTS 



SJ2 



Max Min. 



Report Card 
Mean 



OUTCOMES 

Basic Skills First (BSF) 

Reading 
Math 

Stanford (STAT); Task 2 

Reading 
Math 
Englisn 
Science 
Social Studies 

TN Proficiency Test 

Language 

Math 

Both 

MONEY 

Co ./Capita Income ($)(CCI) 
Stud. Expenditure ($)(EPP) 
Aver. Prof. Salary ($) (APS 

SCHOOL SYSTEM 

Average Daily Mem.(#) (ADM) 
Student Attendance |%SA) 
Oversized Class (%OC) 
Free/Reduced Lunch (%FRL) 
Career Ladder ll/lll (%CL) 



(Pftrrpnt passing: 8th grade 
4.9 121 91 65 81 
7.7 121 85 43 66 

tfitfipiriP sr-nre^: 12th grade 
0.5 121 7 4 5 

0.5 121 6 4 5 

0.6 121 7 4 5 

0.5 121 6 3 5 

0.5 121 6 4 5 



8.6 


121 


98 


56 


76 


6.4 


121 


98 


59 


90 


9.3 


121 


98 


48 


76 


1,962 


121 


19,318 


6,934 


12,878 


509 


121 


4,891 


2,318 


3,304 


2,693 


121 


34,797 


21 ,286 


26,756 


12,395 


121 


104,788 


375 


5,87 4 


1.3 


121 


97.1 


90.3 


93.6 


4.1 


110 


21.5 


0.1 


3.8 


14.5 


121 


86.0 


9.0 


42.0 


5.9 


121 


41.5 


4.1 


14.8 



11 



Between 1989 and 1991, average per pupil expenditures rose about $100, and average county 
per capita income had fallen by about $500. Average professional salaries of educators had increased 
about $700. The percentage of students receiving free or reduced lunches remained static at 
approximately 42 percent, and the percent of oversized classes dropped only 3 tenths of one percent. 

B. Findings Pertinent to Research Questions 

1 . How do school district characteristics currently reported relate to student academic 
achievement results? 

As in the 1988-89 studies, a correlation matrix (Appendix B) was generated to assess the 
relationship between each reported characteristic and MSOs. However, four sets of relationships could 
be determined for 1991 : one for Elementary School Outcome Level (EOL), one for Middle School 
Outcome Level (MOL), one set for High School Outcome Level (HOL), and one for the System Outcome 
Level \SOL). The same correlation matrix (see Appendix B) displays relationships between independent 
variables and system outcomes (SOL). 

In response to question 1 , Appendix B shows correlations exceeding ±.50 between four district 
characteristics and EOL : percent of free or reduced lunches (r= -.70), percent of upper career ladder 
professionals (r= .62), percent of special education diplomas (r= -.53), and percent of Chapter 1 students 
(r= -.68). Five characteristics correlated above ±.50 with MQL: percent of free/reduced lunches 
(r= -.69), percent of upper Career Ladder teachers (r= .65), average professional salaries (r= .51), 
percent of Special Education diplomas (r= -.69), and percent of Chapter 1 students (r= -.69). High 
correlations (above ±.50 ) existed between HOL and five district characteristics: percent of student 
attendance (r= .53), percent of free/reduced lunches (r= -.69), percent of upper Career Ladder teachers 
(r= .55), percent of special education diplomas (r= -.55), and percent of Chapter 1 students 
(r= -.74). When academic outcomes (MSO) for the entire system were the focus, four system 
characteristics demonstrated correlations above +.50: percent free/reduced lunches (r= -.73), percent of 
upper Career Ladder teachers (r= .64), percent special education diplomas (r= -.62), and percent of 
Chapter 1 students (r= -.73). 

Academic outcomes at all levels were influenced positively by the presence of expert teachers 
(upper Career Ladder teachers) and to a somewhat lesser degree by attendance. Attendance most 
influenced HOL performance. Most severe negative influences on academic performance at all levels 
were percent of students receiving free/reduced cost lunches and percentage of Special Education 
and/or Chapter 1 students. 
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A second set of data relating to question 1 (see Table 7 and Appendix C) provided a Guttman's 
Partial Correlation (r 2 ) matrix for each of the four outcome levels and for the 15 targeted system 
characteristics, and a display of the percentage of influence exerted by each system characteristic on 
each set of MSOs. Findings included: 

1 . Characteristics having greatest impact on student academic performance were not the same at 
all levels (see Figure 1). The factor most influencing the EOL was per pupil expenditure (1 1 .2%). 
Middle school student academic performance was most impacted by the same factor (8.1%). 
Academic performance among high school students was most influenced by their attendance 
(13.6%), as was overall academic performance in the school district (13.3%). 

2. The factor having least impact on MSOs also varied by school level. The size of the system 
(ADM) had least influence on elementary student performance (0.1%). Neither the number of 
schools in a system nor the county per capita income had any influence on MOLs (0.0%). HOL 
was least influenced by the percentage of Special Education students in the district and the 
percentage of Career Ladder II and III teachers teaching there (0.0%). Overall MSO in a system 
was least impacted by average professional salaries of educators (0.1%). 

3. Percentage of oversized classes, a rough indicator of the influence of class size on student 
performance, has increasingly less influence on student academic performance as students 
progress from elementary to middle to high school. Even at its most influential point (the 
elementary years), this factor accounts for only 3.4 percent of whatever it is that influences 
student academic outcomes. 



Table 7 Guttman's partial correlation (r 2 ) used to evaluate the 15 report card categories from 4 
educational levels (elementary (EOL), middle school (MOL), high school (HOL), and 
system (SOL), 1990-91 Tennessee school district report card data. 





#SCH 


ADM 


%SA 


%EC 


O 
O 

s? 


%FRL 


EPP 


CCI 


%CL 


APS 


D-HS 


D-HO 


%vo 


%SE 


%CH! 


EOL 


0.2 


0.1 


6.7 


0.3 


3.4 


7.3 


11.2 


0.4 


3.2 


1.0 


1.1 


0.3 


0.8 


1.5 


2.1 


MOL 


0.0 


0.2 


5.9 


0.3 


2.8 


2.3 


8.1 


0.0 


4.9 


0.3 


1.9 


1.5 


1.0 


0.1 


6.0 


HOL 


4.5 


5.3 


13.6 


3.5 


0.2 


0.3 


0.4 


0.6 


0.0 


2.7 


0.2 


0.4 


4.5 


0.0 


4.7 


SOL 


0.4 


0.9 


13.3 


1.5 


3.1 


4.7 


9.4 


0.4 


3.1 


0.1 


1.5 


0.2 


2.9 


0.2 


6.5 



o 
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Percentage of Influence 




Figure 1 The percentage of influence for the 15 report card categories and the four levels 
(elementary [EOL), middle [MOL], high school [HOL], and system (SOL], 1990-91 
Tennessee report card data. 
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2. Are there differences In the relationships between dependent and Independent variables 
at different school levels? 

The answer to this question is clearly "yes" as demonstrated by data in Appendix C. We have 
already reported the ditterences in system characteristics having most and least impact on student 
academic outcomes at the various school levels. No, system characteristic influences student academic 
outcomes in the same way at all school/district levels. The combined set of 15 characteristics does not 
exert the same amount of influence on MSOs at any of the four levels studied. This finding will be 
explored more completely in response to research question 5. 

Other relationships demonstrated in Appendix C are important. The presence of upper Career 
Ladder teachers appears to have greatest impact on student performance at the middle school level 
(4.9%). The average professional salaries paid within a school district do not have great influence on 
student performance, but they have more influence (2.7%) on secondary students than on any other 
group. The socio-economic level of the community (county per capita income) had less than one percent 
influence on academic outcomes at any level. 

The histogram presented in Figure 1 portrays the statistics presented in the Appendix C. Note 
particularly the positions of the influence occupied by percent student attendance (%SA), expenditure per pupil 
(EPP), and percent of students receiving free/reduced lunches (%FRL) in relationship to the other variables. 

3. Are there differences In the relationships between dependent and Independent variables 
at different grade levels (2nd, 3rd, 4th, etc.)? 

The matrices presented in Appendix D and in Table 8 display the percentage of influence ("r 2 ") of 
each community/school characteristic on MSO at each grade level in 1990-91 , second through eighth 
and tenth. Similar to the school-level analysis, hq characteristic exerted the same level of influence on 
MSO at every grade level. The characteristics having the greatest impact on MSO across grade levels 
(mean of grade level percentages) were expenditure per pupil (6.0%), percent of student attendance 
(4.4%), percentage of free/reduced lunches (3.5%), and percentage of Career Ladder teachers (3.6%). 
Characteristics exerting the least impact on MSO across grade levels were number of schools in the 
district (0.4%), average daily membership (0.4%), average professional salaries (0.9%), and percentage 
of enrollment change (0.9%). 

Only five characteristics exerted six percent or more of all influence on MSOs at any grade level: 
percentage of student attendance, percentage of free/reduced lunches, expenditure per pupil, 
percentage of Career Ladder teachers II & III .and percentage of Chapter 1 students. Of these five 
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characteristics, only three exerted that level of influence (6 percent or more) on MSO at more than one 
level. Student attendance accounted for 13.2% of MSO at second grade and 6.6% percent MSO at 7th 
grade. Percentage of free/reduced lunches produced 8.5% of the influence on MSO at fourth grade and 
1 1 .3% at the fifth grade. Per pupil expenditure exerted substantive influence at the third (1 1 .7%), fourth 
(8.2%), fifth (10.6%), and seventh (6.4%) grade levels. 

Analysis of Table 8 data indicates some shifts in influence exerted by a single district characteristic 
from one grade level to the next. For example, the influence of percentage of student attendance dropped 
from 13.2% in the second grade to 3.5% in the third. Influence of free/reduced lunches fell from 1 1 .3% in 
the fifth grade to 2.8% in the sixth grade. A rise from 1 .6% to 1 1 .7% in the influence of expenditure per 
pupil appeared between grades two and three, and percentage of Career Ladder II & III teachers had far 
less influence on third grader's MSO (0.4%) than on second grader's (15.8%). 

When influence of all 15 district characteristics studied on individual grade-level performance is 
summed, the combined influence varies from a high of 48.3% at fourth grade to a low of 194% at sixth 
grade. As in previous analyses, less than 50% of all influence on MSO at any grade level is produced by 
these 15 factors. Performances of fourth graders and second graders are influenced most by the 
combined set of factors (48,3% and 39.9%, respectively). Sixth grade and tenth grade MSOs are least 
influenced by this set of factors (19.4% and 19.5%, respectively). 

Table 9 presents additional interesting information. Simple Guttman's partial correlations (V and 
not "r 2 ") reveal that several variables (precent oversized classes, present free/reduced lunches, precent 
vocational students, percent Chapter I students) exhibit negative correlations with achievement at every 
grade level. It is also interesting to note that the Chapter 1 variable shows a constantly increasing 
negative correlation with achievement in grades 5, 6, 7 and 8. The lower correlation at the 10th grade 
level might be explained by dropout; i.e., students at-risk have dropped out of school by the 10th grade. 
The remainder of the pattern is puzzling, unless it is an indicator of the failure, of Chapter 1 to produce 
long-lasting results. 

Differences in the relationships between independent and dependent variables are found at 
different grade levels. Equal treatment of schools, classrooms, and stud ents at every level does not 
appear to be the most appropriate way to imp rove student performance. 
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Table 9. Results of Guttman's partial correlation (V) by Grade Level. 
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Box =: Categories with negative partial correlations (r). 

4. How do reported school characteristics relate to each other? 

The answer to this question is found in Appendix B. The correlation matrix reveals eight 
correlations exceeding ±.50. The relationship between number of schools in the system and %SA is 
strongly negative (r= -.54). The same can be said of the relationships between %SA and size of school 
district (n= -.54) and between %FRL and %SA (r= -.54). None are surprising statistics. 

There is a strong positive correlation (r= .53) between percentage of special education diplomas 
awarded in a district and the percentage of students receiving free/reduced cost lunches. A strong 
positive correlation (r= .78) exists between percentage of Chapter 1 students in a school district and 
percentage of students receiving free/reduced cost lunches. Special education, free/reduced meals, and 
Chapter 1 are closely linked. 

The relationship between APS in a system and EPP is strongly positive (r= .79). Communities 
that spend more on education pay their teachers and administrators better than do other communities. 
A strong positive correlation (r=.51) is found between percentage of students receiving special education 
diplomas and percentage of students not receiving diplomas. 
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Table 10. School District Rankings By Student Academic Performance, 1990-91 data, based on 
SOL and compared on EOL, MOL, HOL. 
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There is a positive correlation (r=.50) between percentage of special education diplomas awarded 
and percentage of students enrolled in vocational education programs. This correlation could reflect the 
creation of vocationally-oriented programs for special education students, or placement of special 
education students in vocational programs, regardless of the suitability of the programs to the students. 

5. When rank ordered on the basis of student outcomes, how do school districts within the 
state perform in terms of reported school and community characteristics? 

To explore this question, the investigators generated rankings by MSO at the four levels being 

investigated and by system characteristics for the top 10 and bottom 10 producing systems, using system 

MSOs (SOL) as the anchor. Table 10 and Appendix E present the findings. Table 10 displays the 

relationships between SOLs and school levels. Among important findings are the following: 
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1 . The system having the highest MSO (#72) had the highest elementary and middle school MSOs, 
but not the highest high school MSO. 

2. Eight of the top 10 systems ranked by district MSO were not in the top 10 at the elementary, 
middle, or high school levels. 

3. The district ranking 10 in SOL ranked 60th in HOL performance. 

4. No district ranking among the bottom 10 districts in district MSO ranked above 94th position at 
any school level. 

Appendix E provides data about school district/community characteristics in relation to system 
level MSO rankings. It also profiles the relationships between system/community factors and HOLs. 
Note the following: 

1 . There are no readily identifiable patterns of school/community characteristics among those 
currently reported that produce high achieving or low achieving school systems. 

2. There are no common patterns of school/community characteristics among those reported that 
appear consistently to produce high achievement or low achievement among high school students. 

3. Typical biases about characteristics necessary in a system or community to produce high 
achievement (e.g., money, larger or smaller schools, small classes) are not confirmed by the 
data available. Schools and communities with a range of the characteristics currently reported 
produce both higher and lower academic achievement. 

6. Do the reported school district characteristics appear to represent all or most factors that 
influence student academic achievement? 

The answer to this question is found in Appendix C. Clearly, the answer is. "NO ." Together, the 
15 characteristics under investigation provide 39.6 percent of the influence on EOL, 35.3 percent of the 
influence on MOL, 40.9 percent of whatever influences HOL, and 48.2 percent of the influence on SOL 
These factors influence outcomes at different levels in different ways, and together they account for less 
than half of whatever influences student performance at any leve l. Further, they account for less than 
50% of the influence on student outcomes at any single grade level as indicated in the response to 
question #3 (see Table 8, p. 16). The influence pattern ranged from a low of 19.4 percent at the sixth 
grade level to a high of 48.3 percent at the fourth grade level. 

7. Is there evidence of majr ; change In student academic performance from one school hvel 
to another within school districts? 

Table 1 1 provides the data pertinent to this question. Eleven systems demonstrated shifts 
downward in MSO of at least one standard deviation somewhere between the elementary and the high 
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Table 1 1 . School districts with outcomes greater/smaller than +<1 .0 z-scores between the 
elementary, middle, or high school levels. 



Elementary Middle High School System Differences 
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KEY: 

SYS = State System ID 

EOL = Elementary Outcome Level 

MOL = Middle School Outcome Level 



HOL m High School Outcome Level 
SOL = System Outcome Level 
Bold = Unusual data 
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school levels. Sometimes the shift occurred from elementary to middle school, sometimes from middle to 
high school. Sometimes the change was continuous from level to level, and sometimes a dramatic shift 
occurred from elementary to middle, but began to reverse from middle to high school. 

Twelve systems demonstrated changes of at least one standard deviation upward over the three 
school levels. Again the patterns of change were not always constant, and the shifts occurred at different 
points in different systems. 

Some of the notable change patterns can be seen in reviewing the changes in academic 
rankings within a system from level to level: 

1 . Six of the 1 1 systems showing downward shifts in MSO had consistent downward trends from 
the elementary to middle to high school levels. 

2. Three districts showed significant declines in MSO from the elementary to middle school level, 
but reversed the trend from middle to high school. System #82 demonstrated a dramatic 
downward shift from elementary to middle school (20th to 78th) and a dramatic shift upward from 
middle to high school (78th to 18th). 

3. Two districts (#71 , #9) displayed better student performance (by rank) at the middle school level 
than at the elementary level, but dropped markedly in the high school rankings. 

4. Of the 1 2 systems demonstrating upward shifts in MSO, six showed consistent patterns of 
improvement at each school level. Perhaps the most dramatic pattern was exhibited by system 
#1 which ranked 106 (of 120) in EOL, 23 in MOL and first in HOL. Data for this system also 
clearly point up the limited value of district-level rankings . In the composite, this system ranked 
28th in SOL. 

5. Three systems (#41 , #74, #52) displayed downward patterns of achievement from elementary to 
middle school, but strong upward patterns from middle to high school. 

6. Three systems (#90, #64, #51) showed strong upward trends in MSO and ranking from the 
elementary to middle school level, but reversed the pattern from the middle to the secondary level. 

The data presented do not suggest the causes of the changes found among these 23 school 

districts. Changes could relate to the quality of instruction at the several levels. They might reflect an 

emphasis on "teaching to the test" at certain levels. They could indicate the lack of alignment between 

outcome measure (tests) and curriculum. They might be caused, in part, by the movement to a new set 

of tests (TCAP) during the year being investigated. What is clear is that outcome data and rankings 

reported at the system level have limited utility in identifying what is happening academically within a 

system or in targeting areas for improvement. 

8. When academic achievement Is treated as scores on two separate test batteries (TCAP 
and TPT), are patterns of Influence changed? 

Appendix F presents the findings pertinent to this question. Percentages of influence of each 
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school district characteristic on each high school student achievement measure (TCAP, TPT) were 
compiled. The high school TCAP score was used because it represents the 10th grade level, the level 
close&t to the point (9th grade) where the TPT is administered. Several statistics are noteworthy: 

1 . The combined influence of the 15 factors varies greatly from test to test (TCAP=19.5%, 
TPT=41.6%). 

2. Student attendance plays a much more important role in passage of the TPT (13.7%) than in the 
scores attained on the TCAP (3.0%). 

3. Oversized classes influence TCAP scores (1.3%) more than passing TPT (0.1%), but the 
influence is not great in either case. 

4. Size of the school district (number of schools and ADM) has more influence on TPT scores 
(5.5%, 5.1%) than on TCAP scores (0.9%, 0.6%). 

The difference in what is being reported in the two scores may have significant impact on the 
influence patterns. The TPT results are simply a summary of the percentage of students receiving 
scores of 70 percent or better on all sub-tests (criterion-referenced). TCAP results reported are school- 
level mean scores on the test (norm-referenced). At any rate, various factors in the school district do 
influence outcomes on these two measures differently. 

9. What differences in relationships among variables exist when test results of special 
education students are Included In the analyses? 

Data appearing in Appendix G provide the response to this question. When rankings of the top 
25 and bottom 25 performing school districts with special education students 1 TPT scores included were 
compared with the rankings for the same districts excluding special education results, there were some 
changes in rankings, but no district originally ranked in the top or bottom group moved out of that 
respective group. 

Shifts in ranked position were both upward and downward. Few were dramatic; i.e., shifts 
usually did not change rank by more than a position or two. Among the top 25 districts, one district 
dropped six positions when special education students' scores were dropped from consideration. 
Another district rose six positions under the same circumstances. Among the bottom 25 districts, three 
climbed markedly in rank when special education results were removed. Two districts dropped more 
than four positions. In large part, special education students' test results did not dramatically influence 
the overall academic performance of the school district. 
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10. How do the results on this study compare with the results of the investigation using 1988- 
89 Report Card data? 

Results of the studies ( 1988-89 and 1990-91) are not comparable in several areas. . Student 
outcome measures (tests) changed in the interval, and the 1990-91 report cards provided more and 
somewhat different data than in 1988-89. 

Changes and similarities in the basic statewide system profiles have already been presented in 
the descriptive analysis of school districts {see pp. 2-5). Therefore, the comparisons presented here 
focus on findings in response to similar research questions in the two studies. 

The 1988-39 studies reported positive correlations between school district MSO and five school 
district characteristics: county per capita income, average professional salaries, per pupil expenditure, 
student attendance, and percentage of upper Career Ladder teachers. In that study, two district 
characteristics (%OC and %FRL) correlated negatively with student academic performance, and one 
characteristic (ADM) demonstrated no significant correlation to student outcomes. 

In 1990-91 , system MSO (or SOL) correlated positively with the five district characteristics: 
student attendance, per pupil expenditure, county per capita income, average professional salaries, and 
percentage of upper Career Ladder teachers. The same two district factors that correlated negatively 
with student performance in 1988-89 (%OC and %FRL) demonstrate that relationship again in 1990-91 . 
In the 1990-91 study, size of school district (ADM) also demonstrated a negative correlation with 
academic p3rformance. Relationships among variables change little from test to test or year to year 
(correlation data can be found in Appendix B ( and in Bobbett, French, and Achilles, eta!. 1 « 2 ' 3 ' & 4 ). In 
1988-89, correlations exceeding .50 (±) were found among four sets of system characteristics: 

CCI and APS, r=.71 APSandEPP, r=.78 

CCI and ADM, r=.53 
CCI and %FRL, r= -.53 

When examining the same district characteristics using 1990-91 data, three correlations 
exceeding .50 (±) were found: 

%SA and ADM, r= -.54 APS and EPP, r= .79 

%SA and %FRL, r= -.54 

Only one pair of characteristics (average professional salaries and expenditure per pupil) exhibited 
essentially the same relationships in the two studies. However, many of the positive and negative 
correlations below ±50 were exhibited from study to study. 
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One comparison available from the two studies is the influence on MSO of the eight school district 
factors studied in 1988-89 and the 15 factors investigated in the current study. Table 12 presents the data. 

What produces the changes in influence of various factors is unclear. However, several 
observations can be made. 

1 . Attendance is still the most dominant factor in student achievement, among factors available for 
study. 

2. In both studies, factors considered by many to be major contributors to or inhibitors of student 
academic performance (e.g., teacher salaries, percent oversized classes, county per capita 
income) by themselves have limited influence. 

3. Doubling the number of factors included in the analysis almost doubles the amount of influence 
for which one can account, but the 15 characteristics under scrutiny in the current study still 
account for less than half of whatever influences student performance. 

4. The change in student outcome measures from 1988-89 to 1990-91 may have significant impact 
on the data. If so, the importance of test/outcome measures themselves is underscored again. 

IV. CONCLUSIONS AND IMPLICATIONS OF THE STUDY 

As in the initial study, investigators framed a final research question as a means of developing 
useful conclusions and implications. 

1 1 . How might the findings of this study inform educational policy at state and local levels? 

Several of the conclusions of the 1988-89 studies were reinforced by the results of the 1990-91 
investigations. Specifically, policymakers at all levels need to consider that few of the individual inputs 
commonly associated with student achievement have much impact on student performance. With the 
exception of student attendance (and perhaps per pupil expenditure) treatment of any isolated variable 
will have little effect. If we want to improve or change student performance, a systemic approach to 
educational change is an absolute necessity. 

In the 1988-89 studies, the researchers concluded that the eight system characteristics taken 
from the Tennessee Report Cards for analysis were of limited value; i.e., they give limited information to 
policymakers and educators who want to improve education in their states and local communities, 
because these variables accounted for so little of the influence on student outcomes. In the 1990-91 
investigations, 15 variables were examined. Again, they do not appear to be the "right ones . H i.e., they 
don't tell us enough about what influences student achievement. Based on the two studies, knowledge 
gained from review of related research and experience in schools, the investigators urge that 
considerati on be given to collecting, reporting, and analyzing data on such things as school organization 
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Table 12. Comparison of Influence Exerted On Student Academic Outcomes By School District 
Characteristics in 1988-89 and 1990-91. 
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school culture, student m otivation, parental involvement, instructional methodologies, curriculum features 
and other factors to trv to find factors that mav have significant influence on student performance. 

When reviewing the results of the 1988-89 studies, the investigators suggested that building-level 
data are probably more useful and more valid than districMevel data for use in report cards. That 
conclusion is confirmed by the present study. Major variations and fluctuations in results appeared from 
school level to school level and grade level to grade level within individual school districts. Identification 
of sources of these differences could be useful to educators and policymakers seeking improvement. 
Even the 1990-91 study did not have building-level data available for analysis. School-level data in the 
study may reflect conditions across several schools. 

Report cards are only as good as the assessments used to determine student performance. The 
1988-89 studies raised some questions about the assessments being used. Those questions are 
highlighted in the findings of the current study. Enough variations in similar analyses between the studies 
exist to suggest that the differences in student outcome measures are probably one cause. 

The numerous variations found in influence patterns from grade level to grade level and school 
level to school level provide a great deal of food for thought. Much support has been given to the notion 
that schools and learners within a school district should be treated equally; i.e., per pupil expenditures, 
class size, quality of teachers and other factors should be the same in all situations. The findings of this 
study indicate that some factors are more important to student achievement at some levels than at 
others. Equal treatment mav actually promote educational inequities within a school district. 

Finally, "What is the purpose of School District Report Cards?" The question is not an 
antagonistic one, but a supportive one. Definition of purpose or purposes is central to assessing the 
value of report card contents. A recent editorial in the Nashville Tennessean (1992) speaks of 
Tennessee's report cards in glowing terms: 

It (the Report Card) is simply the most comprehensive report in this or any state on 
school funding and student performance. . . 

The reports are more than just a tool for comparison, however; they can empower 
local communities to act. The reports give Tennesseans the power to get the job done 
and make the grade for better schools, (p.40). 

If the purpose of the Tennessee Report Card is simply to report the status of a community's 
schools and selected factors generally associated with them, the current report card may get by. If the 
purpose is to provide citizens, parents, educators and policymakers meaningful information upon which 
to make decisions for improvement, much is lacking. At best, at least 50 percent of what influences 
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student performance has not been reported. This can provide serious impediments to school 
improvement, if education leaders focus entirely on what is now being reported as the primary sources of 
improvement in student performance. 



V. A Footnote 

As an outgrowth of their several analyses of Tennessee's report cards the investigators have 
begun study of report cards now in existance in other states. Review of the report cards available 
immediately highlights certain problems in comparing data from state to state. For example, there is no 
common approach to statistical analysis of report card data (where such analyses are conducted at all). 

At least three approaches to analysis of the impact of school/community variables on student 
achievement are currently in use, each championed by the researchers employing it. As the reader is well 
aware, the Tennessee studies conducted by the authors of this paper have depended heavily on Guttmarfs 
partial correlation procedure. Studies in other states employing forward stepwise regression (Harris, 1985) 
analysis have been reported. Multiple regression (Harris, 1985) analysis also has been used. 

When the results of the Guttman's partial correlation, stepwise regression, and multiple 
regression were applied to the 1990-91 data, the results of the three types of statistical analysis varied 
greatly (see Table 13). The percentages of influence on student outcomes generated for the combined 
set of school/community variables vary with the statistical precedure employed. 

This finding poses several critical questions for both researchers and policymakers who may use 
the results of the research: 

1 . Is there a "best" statistical analysis procedure that should be applied to report card data; i.e., one 
that is most defensible and that will provide the most valid information for use in decisions about 
educational restructuring and improvement? 

2. Should there be dialogue among state and national policymakers, educational agencies and 
researchers about uniform ways of treating report card data? 

3. Should there be dialogue among state and national policymakers, educational agencies and 
researchers that might lead to agreement about report card entries, their analyses and their use? 

If school, district and state level report cards are to become a useful tool of the educational 
accountability and improvement initiatives, it would appear that all three of these questions, as well as 
others yet to be posed, need to be addressed. The authors of this paper have already begun the 
collection and analysis of pertinent data. Findings, implications and recommentatfons will be reported over 
the next several months. 
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Table 13 



Comparison Among the Results of Guttman's Partial Correlation, Forward Stepwise 
Regression, and Multiple Regression Analyses Using 15 
Tennessee Report Card Categories 
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Appendix A 



Results of Kaiser Test of Variable Sampling Adequacy 

20 report card variables 
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Appendix C 



Partial Correlations and Percent of Influence of 15 School District 
Characteristics On School-Level Mean Student Outcomes 
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-.08 


.14 


.37 


.0% 


15 %CH1 


-22 


.01 


-.04 


!l7 


-!l9 


-.28 


.46 


-.01 


-.09 


-.06 


-!08 


-.24 


-.20 


!l8 


-.06 .64 


4.7% 


Total 
































40.9% 




SOL 


#SCH 


ADM 


%SA 


%EC 


%OC %FRL 


EPP 


CCI 


%CL 


APS 


D-HS 


D-HO 


%VO 


%SE %CH1 




SOL 


.70 
































1 #SCH 


.07 


.99 




























.4% 


2 ADM 


-.10 


.99 


.99 


























.9% 


3 %SA 


.37 


-.09 


.08 


.46 
























13.3% 


4%EC 


.12 


-.14 


.13 


.28 


.46 






















1.5% 


5%OC 


-.18 


.01 


-.01 


-.02 


.02 


.32 




















3.1% 


6%FRL 


-.22 


-.08 


.13 


-.03 


-.13 


.04 


.73 


















4.7% 


7 EPP 


.31 


.26 


-.27 


-.21 


.11 


.06 


.54 


.84 
















9.4% 


8 CCI 


-.07 


.00 


-.01 


-.05 


.17 


-.35 


.07 


.04 


.27 














.4% 


9%CL 


.18 


.05 


-.07 


.05 


.02 


.04 


.18 


-.29 


-.07 


.44 












3.1% 


10 APS 


.04 


-.28 


.33 


.03 


-.19 


-.17 


-.49 


.80 


.01 


.40 


.89 










.1% 


1 1 D-HS 


.12 


.03 


-.05 


.22 


-.38 


-.11 


-.06 


.23 


-.09 


.01 


-.32 


.73 








1.5% 


12 D-HO 


-.05 


.15 


-.17 


.19 


-.23 


-.15 


-.11 


.20 


-.03 


.21 


-.20 


-.74 


.69 






.2% 


13%VO 


-.17 


-.02 


.03 


.08 


.29 


-.07 


-.19 


.42 


-.17 


.09 


-.26 


-.01 


-.10 


.39 




2.9% 


14%SE 


.04 


.00 


-.03 


.02 


-.26 


.09 


-.08 


.24 


.26 


.12 


-.29 


-.27 


-.08 


.15 


.37 


.2% 


15%CH1 


-.r*i5 


-.03 


-.01 


.18 


-.20 


-.31 


.40 


.06 


-.09 


-.01 


-.11 


-.21 


-.20 


.18 


-.04 .65 


6.5% 




! #SCH ADM %5A %EC %OC %FRL EPP CCI %CL APS D-H5 D-HO %VO %5E %CH1 Total 

I EOL 02 OA 67 ol 51 73 iT3 51 52 i3 53 ol T! El 331RJ" 

'MOL 0.0 0.2 5.0 0.3 2.1 2.3 6.1 0.0 4.0 0.3 1.9 1.5 1.0 0.1 6.0 35.30 
HOL 4.5 5.3 13.6 3.5 0.2 0.3 0.4 0.6 0.0 27 02 0.4 4.5 0.0 47 40.90 
jSOL 0.4 0.0 13.3 1.5 3.1 4.7 0.4 OA 3.1 0.1 13 0.2 2.0 02 6.5 48.20 
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Appendix D 



Partial Correlations and Percent of Influanca on 15 School District 
Characteristics on Grade-Level Maan Student Outcome 



6lh 


I 83 




























1 #SCH 


-.08 


.99 


























2 ADM 


.10 


.99 


.99 
























3 %SA 


.17 


-.05 


.03 


.40 






















4%EC 


.13 


-.12 


.11 


.32 


.46 




















5%OC 


-.24 


-.02 


.03 


-.05 


.03 


.34 


















6%FRL 


-.29 


-.12 


.17 


-.06 


-.12 


.00 


.74 
















7EPP 


.29 


.30 


-.33 


-.16 


.11 


.07 


.55 


.84 














8 CCI 


.01 


-.01 


.00 


-.08 


.16 


-.34 


.09 


.02 


.26 












9 %CL 


.01 


.07 


-.09 


.12 


.04 


.01 


.14 


-.24 


-.08 


.42 










10 APS 


-.13 


-.29 


.34 


.07 


-.17 


-.20 


-.52 


.84 


.01 


.41 


.89 








11 D-HS 


.23 


.05 


-.08 


.23 


-.39 


-.07 


-.01 


.20 


-.09 


.03 


-.28 


.74 






12 D-HO 


.23 


.16 


.18 


.14 


-.26 


-.08 


-.03 


.12 


-.03 


.20 


-.16 


-.76 


.70 




13%V0 


-.20 


-.05 


.07 


.06 


.29 


-.09 


-.21 


.43 


-.15 


.07 


-.29 


.02 


-.04 


.40 


14 %SE 


.14 


.01 


-.04 


.01 


-.28 


.12 


-.04 


.21 


.26 


.13 


-.27 


-.29 


-.11 


.17 


15%CH1 


-.13 


-.05 


.03 


.12 


-.22 


-.30 


.42 


.02 


-.07 


-.05 


-.13 


-.22 


-.16 


.20 



.38 
-.04 



.63 



5th #SCH ADM %SA %EC %OC %FHL EPP CCI %CL APS P-HS D-HO %VO %SE %CH1 





2nd #SCH 


ADM 


%SA 


%EC 


%OC %FRL 


EPP 


CCI 


%CL 


APS 


D-HS 


D-HO 


%vo 


%SE %CH1 




I2nd 


I .50 






























0.4% 


1 #S£M 


.06 


.99 




























2 ADM 


-.07 


.99 


.99 


























0.5% 


3%SA 


.36 


-.09 


.07 


.46 
























13.2% 


4 %EC 


-.01 


-. 1 


.12 


.33 


.45 






















0.0% 


5%OC 


-.14 


.01 


-.01 


-.03 


.00 


.32 




















2.0% 


6 %FRL 


-.09 


-.09 


.14 


-.08 


-.16 


.06 


.72 


















0.8% 


7 EPP 


.13 


.28 


-.30 


-.15 


.15 


.03 


.52 


.83 
















1.6% 


8 CCI 


-.15 


.00 


-.01 


-.02 


.16 


-.36 


.07 


.04 


.28 














2.3% 


9 %CL 


.40 


.04 


-.05 


-.04 


.04 


.06 


.17 


-.28 


-.01 


.52 












15.8% 


10 APS 


-.02 


-.28 


.33 


.05 


-.19 


-.18 


-.51 


.84 


.00 


.38 


.89 










0.0% 


11 D-HS 


-.03 


.04 


-.06 


.28 


-.37 


-.14 


-.09 


.29 


-.10 


,C4 


-.32 


.73 








0.1% 


1 2 D-HO 


-.09 


.15 


-.17 


.21 


-.24 


-.15 


-.11 


.21 


-.04 


.22 


-.20 


-.75 


.69 






0.8% 


13%V0 


-.02 


-.03 


.05 


.03 


.27 


-.04 


-.16 


.39 


-.16 


.07 


-.27 


-.03 


-.10 


.38 




0.0% 


14%SE 


.15 


-.01 


-.02 


-.02 


-.26 


.11 


-.07 


.24 


.27 


.06 


-.29 


-.26 


-.07 


.15 


.39 


2.1% 


15%CH1 


-.04 


-.04 


.01 


.10 


-.24 


-.28 


.48 


-.02 


-.08 


-.04 


-.12 


-.26 


-.19 


.23 


-.05 .63 


0.1% 

39.?% 




3d #SCH 


ADM 


%SA 


%EC 


%OC %FRL 


EPP 


CCI 


%CL 


APS 


D-HS 


D-HO 


%vo 


%SE %CH1 




]3d 


| .45 
































1 


-.08 


.99 




























0.7% 


2 ADM 


.05 


.99 


.99 


























0.2% 


3 %SA 


.19 


-.05 


.04 


.40 
























3.5% 


4%EC 


-.06 


-.13 


.12 


.36 


.45 






















0.4% 


5%OC 


-.13 


-.01 


.01 


-.07 


-.01 


.31 




















1.6% 


6%FRL 


-.16 


-.11 


.16 


-.09 


-.17 


.06 


.72 


















2.5% 


7 EPP 


.34 


.30 


-.31 


-.17 


.16 


.05 


.53 


.85 
















11.7% 


8 CCI 


-.02 


-.01 


.00 


-.07 


.1* 


-.35 


.08 


.03 


.26 














0.1% 


9 %CL 


-.07 


.06 


-.09 


.13 


.03 


.00 


.13 


-.21 


-.08 


.43 












0.4% 


10 APS 


-.10 


-.28 


.33 


.06 


-.19 


-.19 


-.52 


.83 


.00 


.40 


.89 










0.9% 


11 D-HS 


.04 


.04 


-.06 


.27 


-.36 


-.13 


-.08 


.25 


-.09 


.04 


-.31 


.73 








0.2% 


12 D-HO 


.07 


.15 


-.17 


.17 


-.23 


-.13 


-.09 


.16 


-.02 


.21 


-.19 


-.75 


.69 






0.5% 


13%V0 


.01 


-.03 


.05 


.02 


.27 


-.04 


-.15 


.36 


-.18 


.07 


-.27 


-.03 


-.09 


.38 




0.0% 


14%SE 


-.05 


.00 


-.03 


.05 


-.26 


.08 


-.09 


.27 


.26 


.13 


-.29 


-.26 


-.08 


.15 


.37 


0.2% 


15%CH1 


-.20 


-.06 


.02 


.13 


-.25 


-.30 


.44 


.05 


-.08 


-.07 


-.13 


-.24 


-.17 


.23 


-.06 .64 


3.9% 
26.9% 






#SCH 


ADM 


%SA 


%EC 


%OC %FRL 


EPP 


CCI 


%CL 


APS 


D-HS 


D-HO 


%vo 


%SE %CH1 





0.7% 
0.9% 
3.0% 
1.7% 
5.5% 
8.5% 
8.2% 
0.0% 
0.0% 
1.7% 
5.2% 
5.2% 
4.1% 
1.9% 
1.6% 
48.3% 



ism 


1 * 
































1 #SCH 


-.06 


.99 




























0.3% 


2 ADM 


.05 


.99 


.99 


























0.2% 


3 %SA 


.01 


-.07 


.05 


.38 
























0.0% 


4%EC 


.12 


-.12 


.11 


.35 


.46 






















1.5% 


5%OC 


-.07 


.00 


.01 


-.09 


.01 


.31 




















0.5% 


6%FRL 


-.34 


-.11 


.16 


-.11 


-.11 


.05 


.75 


















11.3% 


7 EPP 


.33 


.30 


-.32 


-.11 


.10 


.03 


.57 


.84 
















10.6% 


8 CCI 


.02 


-.01 


.00 


-.08 


.16 


-.34 


.09 


.01 


.26 














0.0% 


9%CL 


.12 


.07 


-.10 


.12 


.02 


.01 


.18 


-.27 


-.08 


.43 












1.5% 


10 APS 


-.09 


-.28 


.33 


.05 


-.18 


-.18 


-.51 


.83 


.01 


.42 


.89 










0.8% 


11 D-HS 


.11 


.04 


-.06 


.28 


-.38 


-.13 


-.04 


.23 


-.10 


.02 


-.31 


.73 








1.1% 


12 D-HO 


-.01 


.15 


-.16 


.19 


-.23 


-.14 


-.11 


.19 


-.03 


.20 


-.20 


-.75 


.69 






0.0% 


13%VO 


-.08 


-.04 


.05 


.02 


.28 


-.05 


-.18 


.40 


-.16 


.07 


-.28 


-.02 


-.10 


.38 




0.6% 


14 %SE 


.13 


.01 


-.04 


.04 


-.27 


.10 


-.04 


.21 


.25 


.12 


-.28 


-.27 


-.08 


.16 


.38 


1.6% 


15%CH1 


-.10 


-.05 


.02 


.10 


-23 


-.28 


.42 


.01 


-.07 


-.04 


-.13 


-.24 


-.19 


.22 


-.04 .63 


1.1% 



31.2% 
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Appendix D (continued) 



#SCH ADM %SA %EC %OC %FRL EPP CCI %CL APS P-HS D-HO %VO %SE %CH1 





1 .45 


































J 00 


.99 




























0,0% 


ADM 


-.02 


.99 


.99 


























0,0% 


%SA 


.11 


-.07 


.05 


.39 
























1,1% 


%EC 


-.07 


-.13 


.12 


.36 


,45 






















0,4% 


%oc 


-.14 


.00 


.00 


-.07 


-.01 


.32 




















2,0% 


%FRL 


-.17 


-.10 


.15 


-.10 


-.17 


.05 


,72 


















2,8% 


EPP 


.21 


.29 


-.31 


-.13 


.16 


.04 


.53 


,83 
















4,6% 


CCI 


-.08 


-.01 


.00 


-.07 


,16 


-.35 


,07 


,03 


.27 














0,6% 


%CL 


.14 


.06 


-.09 


.10 


.05 


,02 


,17 


-,27 


-,07 


.44 












2,0% 


APS 


.03 


-.28 


.33 


.04 


-.19 


-,17 


-.50 


,82 


.01 


.40 


.89 










0,1% 


D-HS 


.05 


.03 


-.06 


.28 


-.36 


-.13 


-.08 


,27 


-.09 


,03 


-.32 


.73 








0,3% 


D-HO 


-.13 


.15 


-.16 


.20 


-.24 


-.16 


-.13 


,22 


-.04 


,22 


-,20 


-.74 


.69 






1 ,8% 


%VO 


-.10 


-.03 


.05 


.03 


.26 


-,06 


-.17 


,40 


-.17 


,08 


-,27 


-.03 


-.1 1 


.38 




1 ,0% 


%SE 


-.07 


.00 


-.03 


.05 


-.27 


,08 


-,10 


,28 


.25 


,14 


-.29 


-.26 


-,09 


,14 


.38 


0,5% 


%CH1 


-.15 


-.04 


.01 


.1 1 


-.25 


-.29 


.45 


,01 


-.08 


-.03 


-.1 1 


-,24 


-,21 


.21 


-.07 ,64 


2,4% 
1 9.4% 




7th #SCH 


ADM 


%SA 


%EC 


%OC %FRL 


EPP 


CCI 


%CL 


APS 


D-HS 


D-HO 


%VO 


%SE %CH1 




m 


































#SCH 


-,05 


.99 




























0,3% 


ADM 


.00 


.99 


,99 


























0,0% 


%SA 


.26 


-.05 


.05 


.42 
























6,6% 


%EC 


.06 


-.13 


.12 


.33 


.45 






















0,3% 


%OC 


-.16 


-.01 


.00 


-.04 


.01 


.32 




















2,7% 


%FRL 


-.12 


-.10 


.15 


-.08 


-.16 


.06 


.72 


















1,4% 


EPP 


.25 


.30 


-.31 


-.17 


.13 


.05 


.52 


.84 
















6.4% 


CCI 


-.03 


-.01 


.00 


-.07 


.17 


-.35 


.08 


,03 


,26 














0,1% 


%CL 


.22 


.08 


-.09 


.06 


.02 


.04 


.17 


-.29 


-,07 


.45 












4,6% 


APS 


.08 


-.27 


.33 


.02 


-.19 


-.16 


-.49 


.80 


,01 


,38 


,89 










0,7% 


D-HS 


.09 


.04 


-.06 


.25 


-.37 


-.12 


-.07 


.25 


-,09 


,01 


-.32 


,73 








0,8% 


D-HO 


-.11 


.14 


-.16 


.21 


-.23 


-.16 


-.12 


.22 


-.03 


.22 


-,19 


-.73 


.69 






1,3% 


%VO 


-.15 


-.04 


.05 


.06 


.28 


-.07 


-.17 


.41 


-,16 


,10 


-,25 


-.02 


-.11 


.39 




2,2% 


%SE 


.09 


.01 


-.03 


.01 


-.27 


.10 


-.08 


.24 


,26 


,11 


-,30 


-.27 


-.07 


.16 


,38 


0,8% 


%CH1 


-.16 


-.05 


.02 


.13 


-.23 


-.30 


.46 


.02 


-,08 


-,02 


-,10 


-,24 


-.21 


.21 


-,04 ,64 


2,4% 
30.6% 




8th #SCH 


ADM 


%SA 


%EC 


%OC %FRL 


EPP 


ca 


%CL 


APS 


D-HS 


D-HO 


%VO 


%SE %CH1 




8th 


































#SCH 


,05 


.99 




























0,3% 


ADM 


-.07 


.99 


.99 


























0,5% 


%SA 


,22 


-.08 


.07 


.41 
























4,7% 


%EC 


,14 


-.14 


.13 


.31 


.46 






















1,9% 


%OC 


-,08 


,01 


.00 


-.07 


.01 


.31 




















0,6% 


%FRL 


-.05 


-.10 


.15 


-.11 


-.16 


.07 


.72 


















0,3% 


EP'P 


.20 


.28 


-.30 


-.15 


.12 


.02 


.51 


.83 
















4.2% 


ca 


.08 


-.01 


.00 


-.10 


.15 


-.34 


.09 


,00 


.27 














0.7% 


%CL 


.17 


.06 


-.08 


.08 


,01 


.02 


,15 


-.27 


-,09 


.44 












2,8% 


APS 


.03 


-.28 


.33 


,04 


-.19 


-.17 


-,51 


,82 


.00 


.40 


.89 










0,1% 


D-HS 


.18 


,02 


-.04 


.23 


-.38 


-.12 


-,07 


.24 


-.1 1 


.00 


-.32 


.73 








3,4% 


D-HO 


-.03 


.15 


-.16 


.19 


-.23 


-.14 


-.11 


,20 


-.02 


.21 


-.20 


-.73 


.69 






0,1% 


%VO 


.01 


-.03 


.05 


.02 


.27 


-.04 


-.16 


.38 


-.16 


.06 


-.27 


-.03 


-.09 


.38 




0,0% 


%SE 


-,08 


.01 


-.04 


.06 


-.25 


.08 


-,09 


,28 


.26 


.14 


-,29 


-,24 


-.09 


.15 


.38 


0,7% 


%CH1 


-.26 


-.03 


.00 


.15 


-.20 


-.29 


,45 


.03 


-.05 


-.01 


-,11 


-,19 


-.19 


.23 


-.08 .65 


6.7% 
26.7% 




10th 


#SCH 


ADM 


%SA 


%EC 


%OC %FRL 


EPP 


ca 


%CL 


APS 


D-HS 


D-HO 


%VO 


%SE %CH1 




10th 


~~| .50 
































#SCH 


.08 


.99 




























0,6% 


ADM 


-.10 


.99 


.99 


























0,9% 


%SA 


.17 


-.08 


.07 


,40 
























3,0% 


%EC 


.08 


-.13 


.13 


.33 


.45 






















0,6% 


%OC 


-.11 


.01 


-.01 


-.07 


.01 


,31 




















1,3% 


%FRL 


-.06 


-.09 


.15 


-.11 


-.16 


,07 


,72 


















0,3% 


EPP 


.08 


.29 


-.31 


-.13 


.15 


,02 


.51 


,83 
















0,6% 


ca 


-.02 


-.01 


.00 


-00 


.17 


-.35 


,09 


,02 


.26 














0.0% 


%CL 


.12 


.06 


-.08 


.10 


.03 


.02 


.15 


-.26 


-.08 


.43 












1,5% 


APS 


.17 


-.29 


.34 


.02 


-.20 


-.15 


-.49 


.82 


.01 


.38 


.89 










2,9% 


D-HS 


.10 


.03 


-.05 


.26 


-.37 


-.12 


-.08 


.27 


-.09 


.02 


-.33 


,73 








1,0% 


D-HO 


.02 


.15 


-.16 


.18 


-.24 


-.14 


-.11 


.20 


-.03 


.20 


-.20 


-,75 


.69 






0,0% 


%VO 


-.15 


-.02 


.03 


.05 


.28 


-.06 


-.16 


.40 


-.10 


.08 


-.24 


-,01 


-,09 


.39 




2,2% 


%SE 


.16 


-.01 


-.02 


.01 


-.27 


.10 


-.08 


.25 


.26 


.11 


-.31 


-,27 


-.09 


,17 


.39 


2,5% 


%CH1 


-.14 


-.03 


.00 


12 


-.23 


-.29 


.47 


-.01 


-.08 


-.04 


-.09 


-.24 


-,19 


.21 


-.03 ,63 


2,0% 



19.5% 
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Appendix E 



Profiles of School District Rankings by District Mean Student Outcomes 
and School District Community Characteristics 

System Ou tcome Level (SOL) 

Top 12 SOL Districts 



Rank 


Distric! 


#SCH 


ADM 


< 


O 

9 


%OC 


_J 
DC 


Ql 
0, 
UJ 


CCI 


—J 


APS 


X 

a 


O 

a 


O 

-4- 




%CH1 


1 


72 


"53" 


"52 




"IT" 


17 


—r- 


"IT" 


21 




6 


— sr- 


-23"" 




—fir 


22 


2 


119 


13 


12 


49 


9 


29 


1 


24 


1 


18 


20 


50 


45 


43 


28 


1 
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Appendix F 



Guttman's Partial Correlation (r2) Used to Compare Influence of 
Community/School Variables on TPT and TCAP Results. * 
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Appendix G 



Profile of School District Academic Performance With and Without 
The Inclusion of Special Education 
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